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The  Uncertainty  of  Budget  Projections 
A  Discussion  of  Data  and  Methods 


O  January  26,  2006,  the  Congressional  Budget 
Office  (CBO)  released  The  Budget  and  Economic  Outlook: 
Fiscal  Years  2007  to  2016,  which  presents  CBO’s  latest 
projections  of  federal  revenues  and  outlays  for  that  pe¬ 
riod.  Chapter  1  of  that  report  includes  a  brief  discussion 
of  the  uncertainty  in  CBO’s  baseline  projection  of  the  to¬ 
tal  budget  balance  and  shows  a  figure  (reproduced  here  as 
Figure  1)  illustrating  how  that  uncertainty  increases  as 
the  projections  extend  into  the  future.  This  supplemen¬ 
tary  report  describes  the  data  and  methods  used  to  con¬ 
struct  that  figure.  Throughout  this  document,  the  word 
“deviation”  indicates  the  difference  between  CBO’s  pro¬ 
jections  and  actual  outcomes,  unless  specified  otherwise. 
For  example,  the  deviation  from  a  projected  budget  bal¬ 
ance  means  the  difference  between  the  actual  budget  out¬ 
come  and  the  projected  value.  In  brief,  CBO  calculated 
measures  of  uncertainty  using  the  deviations  from  its  past 
projections  that  arose  from  economic  and  technical  fac¬ 
tors.  Uncertainty  arising  from  legislation  was  not  consid¬ 
ered  because  baseline  projections  assume  that  current  tax 
and  spending  policies  remain  in  place. 

Figure  1  presents  CBO’s  baseline  projection  of  the  budget 
balance  as  a  fan  of  probabilities  around  the  mean  projec¬ 
tion  for  2006  through  2011.  The  fan  widens  as  the  pro¬ 
jection  period  extends.  The  baseline  projection  falls  in 
the  middle  of  the  highest-probability  area — the  darkest 
part  of  the  figure.  But  the  figure  makes  clear  that  nearby 
projections — other  paths  in  the  darkest  part  of  the  fig¬ 
ure — have  nearly  the  same  probability  of  occurring  as  the 
baseline  projection  does.  Moreover,  projections  that  are 
quite  different  from  the  baseline  have  a  significant  proba¬ 
bility  of  being  realized. 1 

1 .  Technically,  the  probability  density  is  highest  near  the  baseline 
and  falls  off  for  more-distant  projections. 


The  shaded  area  in  the  figure  represents  the  90  percent 
confidence  range  (the  range  within  which  the  actual  value 
for  each  year  has  a  90  percent  chance  of  falling).  CBO  es¬ 
timates  that  range  on  the  basis  of  the  uncertainty  in  its 
historical  record  of  budget  projections — a  total  of  24 
baselines  spanning  the  period  from  1981  to  2005. 2  In 
other  words,  the  estimates  of  uncertainty  presume  that,  in 
the  future,  budget  outcomes  will  deviate  from  CBO’s 
projections  as  they  have  in  the  past,  with  about  the  same 
probability  distribution  of  large  and  small  differences. 

CBO’s  analysis  of  uncertainty  separates  deviations  corre¬ 
lated  with  the  business  cycle  from  those  that  are  not. 

That  distinction  helps  in  estimating  the  probability  dis¬ 
tribution  of  the  deviations,  as  discussed  later  in  this  re¬ 
port.  Cyclical  deviations  are  not  expected  to  grow  after 
the  first  few  years  of  a  projection’s  horizon,  whereas  non- 
cyclical  deviations  may  persistently  grow  as  the  projec¬ 
tion’s  horizon  lengthens.  According  to  CBO’s  estimates, 
cyclical  deviations  historically  have  been  small  for  the  first 
two  years  of  a  baseline  projection,  the  period  for  which 
CBO  incorporates  its  views  of  the  business  cycle  in  its 
forecasts.  Those  cyclical  deviations  rise  in  the  later  years 

2.  The  projections  are  those  made  in  July  1981  and  CBO’s  winter 
projections  (usually  published  in  January)  from  1983  through 
2005.  Sufficient  data  were  unavailable  to  use  the  projections  made 
before  1981  or  the  projection  made  in  early  1982.  For  the  two 
years  surrounding  the  1981  projection,  available  data  about  the 
effects  of  legislation  on  changes  in  CBO’s  baseline  budget  projec¬ 
tions  were  insufficient,  and  discretionary  spending  was  not 
reported  separately.  As  discussed  in  the  next  section,  those  data  are 
important  because  the  measures  of  deviations  used  in  this  analysis 
were  constructed  by  removing  the  effects  of  legislation,  including 
discretionary  spending.  The  baseline  budget  projections  that 
CBO  made  before  1980  were  not  comparable  with  later  ones, 
because  the  agency’s  early  economic  assumptions  represented  tar¬ 
gets  rather  than  projections. 
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Figure  1. 

Uncertainty  of  CBO’s  Projections  of  the  Budget  Deficit  or  Surplus 
Under  Current  Policies 


(Deficit  or  surplus  as  a  percentage  of  gross  domestic  product) 


Source:  Congressional  Budget  Office. 

Notes:  This  figure,  calculated  on  the  basis  of  CBO's  forecasting  record,  shows  the  estimated  likelihood  of  alternative  projections  of  the  budget 
deficit  or  surplus  under  current  policies.  The  baseline  projections  described  in  The  Budget  and  Economic  Outlook:  Fiscal  Years  2007  to 
2016  fall  in  the  middle  of  the  darkest  area  of  the  figure.  Under  the  assumption  that  tax  and  spending  policies  will  not  change,  the 
probability  is  10  percent  that  actual  deficits  or  surpluses  will  fall  in  the  darkest  area  and  90  percent  that  they  will  fall  within  the  whole 
shaded  area. 

Actual  deficits  or  surpluses  will  be  affected  by  legislation  enacted  in  future  years,  including  decisions  about  discretionary  spending. 
The  effects  of  future  legislation  are  not  reflected  in  this  figure. 


of  a  projection — when  CBO  does  not  try  to  forecast  the 
business  cycle — but  then  flatten  out  (see  Figure  2). 

Noncyclical  deviations,  by  contrast,  continue  to  grow  in 
the  later  years.3  That  breakdown  suggests  that,  on  aver¬ 
age,  the  deviations  from  CBO’s  projections  of  the  bud¬ 
get’s  bottom  line  have  consisted,  in  roughly  equal  parts, 


3.  CBO  did  not  begin  making  10-year  baseline  projections  until 
1996.  Although  the  agency  published  supplemental  10-year  pro¬ 
jections  as  early  as  1992,  those  reports  did  not  provide  informa¬ 
tion  about  the  budgetary  effects  of  legislation  for  the  extended 
time  periods.  Before  1996,  CBO’s  baseline  typically  extended  out 
five  years  from  the  current  year.  Because  there  are  not  yet  any 
uncertainty  measures  for  the  1 0th  year,  and  only  one  to  four  for 
the  sixth  through  ninth  years,  this  analysis  focuses  on  a  five-year 
projection  horizon. 


of  cyclical  deviadons  and  of  deviadons  due  to  economic 
trends  and  other  noncyclical  factors  that  underlie  the 
budget. 

The  1981-2005  sample  period  is  not  typical  of  the  post- 
World  War  II  period  as  a  whole.  It  contains  only  three  re¬ 
cessions  (those  of  1981  and  1982,  1990  and  1991,  and 
2001)  in  the  25  years — compared  with  seven  in  the  previ¬ 
ous  3 1  years — and  the  two  most  recent  recessions  were 
milder  than  average.  Moreover,  the  1981-1982  recession 
is  not  well  represented  in  the  sample  because  only  one  of 
the  baseline  projections  preceded  it.  If  CBO  had  been 
confronted  over  the  past  two  decades  with  a  less  stable 
economy — one  more  representative  of  the  cyclical  experi¬ 
ence  of  the  whole  post- World  War  II  period — the  cyclical 
component  of  the  deviations  would  have  been  roughly 
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Figure  2. 

Cyclical  and  Noncyclical  Deviations 
from  the  Primary  Surplus  Projections 


(Percentage  of  total  revenues) 


Current  Budget  Budget  Budget  Budget  Budget 

Year  Year  Year+1  Year+2  Year+3  Year+4 

Source:  Congressional  Budget  Office. 

Notes:  The  lines  in  this  figure  show  root-mean-square  errors 

(RMSEs),  a  type  of  average  that  ignores  the  signs  of  individ¬ 
ual  errors  and  gives  greater  weight  to  larger  errors.  The 
RMSE  of  the  total  deviation  is  equal  to  a  value  calculated  by 
squaring  the  RMSEs  of  the  cyclical  and  noncyclical  parts, 
adding  them  together,  and  taking  the  square  root  of  the 
sum.  Thus,  the  combined  RMSE  is  smaller  than  the  sum  of 
the  two  components'  RMSEs. 

The  primary  budget  surplus  is  the  difference  between  federal 
revenues  and  federal  outlays  excluding  net  interest. 

one-third  larger  than  the  noncyclical  component,  on  av¬ 
erage,  instead  of  roughly  equal.  If  CBO  takes  into  ac¬ 
count  the  greater  volatility  of  output  in  that  entire  post- 
World  War  II  period,  the  width  of  the  fan  chart  increases 
by  about  one-fifth,  on  average  (by  10  percent  to  35  per¬ 
cent  in  different  years  of  the  projection  period). 

Whether  the  next  decade  will  more  closely  resemble  the 
past  25  years  or  the  entire  postwar  period  cannot  be  de¬ 
termined  in  advance.  However,  recent  research  suggests 
that  fundamental  changes  in  the  economy  that  occurred 
in  the  early  1980s  may  have  resulted  in  fewer  and  milder 
cyclical  movements  in  the  past  two  decades  and  may 
presage  a  relatively  stable  economy  in  the  future.  Analysts 
differ  on  the  nature  of  those  changes  but  generally  do  not 
expect  a  return  to  higher  volatility  in  the  next  five  years.4 


Preparing  the  fan  chart  involved  two  stages.  In  the  first 
stage,  CBO  constructed  measures  of  past  projection  devi¬ 
ations  that  remove  the  effects  of  changes  in  legislation 
and  other  factors.  In  the  second  stage,  CBO  constructed 
probability  distributions  at  six  time  horizons,  beginning 
with  the  current  fiscal  year  (the  one  in  which  the  projec¬ 
tion  was  made)  and  covering  the  next  five  years.  The 
probability  distributions  were  derived  from  a  model  that 
distinguishes  between  deviations  that  appear  to  stem 
from  the  difficulty  of  forecasting  the  business  cycle  and 
deviations  that  are  not  correlated  with  the  business  cycle 
and  appear  to  stem  from  other  causes. 

Stage  One:  Constructing  the  Measures 
of  Deviations 

Creating  measures  of  deviations  from  CBO’s  past  budget 
projections  involved  adjusting  those  projections  for  two 
factors:  legislation  (including  laws  that  affect  discretion¬ 
ary  spending)  and  net  interest  on  the  federal  debt. 

CBO  added  to  its  projections  of  revenues  and  outlays  the 
estimated  effects  of  laws  concerning  revenues  or  manda¬ 
tory  spending  that  were  enacted  after  the  projections  were 
made.  That  adjustment  was  necessary  because  CBO’s 
baseline  projections  are  intended  to  show  the  future  level 
of  the  budget  deficit  or  surplus  under  the  assumption 

4.  More  specifically,  although  there  seems  to  be  general  agreement 
that  the  growth  of  output  has  become  more  stable  and  that  the 
expansion  phases  of  business  cycles  have  lengthened,  economists 
disagree  about  the  causes  of  that  increased  stability.  Those  dis¬ 
agreements  concern  the  importance  of  factors  such  as  monetary 
policy,  financial  markets  and  institutions,  inflation,  supply  shocks, 
and  inventory  investment.  For  discussions  of  those  and  other 
points,  see  Margaret  M.  McConnell  and  Gabriel  Perez-Quiros, 
“Output  Fluctuations  in  the  United  States:  What  Has  Changed 
Since  the  Early  1980s?”  American  Economic  Review,  vol.  90,  no.  5 
(December  2000),  pp.  1464-1476;  Olivier  Blanchard  and  John 
Simon,  “The  Long  and  Large  Decline  in  U.S.  Output  Volatility,” 
Brookings  Papers  on  Economic  Activity,  no.  1  (2001),  pp.  135-174; 
Marcelle  Chauvet  and  Simon  Potter,  “Recent  Changes  in  the  U.S. 
Business  Cycle,”  The  Manchester  School,  vol.  69,  no.  5  (2001),  pp. 
481-508;  James  M.  Kahn,  Margaret  M.  McConnell,  and  Gabriel 
Perez-Quiros,  “On  the  Causes  of  the  Increased  Stability  of  the 
U.S.  Economy,”  Economic  Policy  Review,  Federal  Reserve  Bank  of 
New  York  (May  2002),  pp.  183-206;  and  Jonathan  McCarthy  and 
Egon  Zakrajsek,  Inventory  Dynamics  and  Business  Cycles:  What  Has 
Changed ?  Finance  and  Economic  Discussion  Series  No.  2003-26 
(Board  of  Governors  of  the  Federal  Reserve  System,  July  2003). 
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that  current  tax  and  spending  policies  remain  the  same.5 
Without  that  adjustment  to  take  into  account  subsequent 
tax  and  spending  legislation,  the  measures  of  deviations 
would  reflect  the  effects  of  later  policy  changes,  which 
would  run  counter  to  the  purpose  of  the  baseline. 

CBO  excluded  discretionary  spending  from  both  the 
baseline  projections  and  actual  outlays.  The  effect  of 
omitting  discretionary  spending  is  to  treat  all  discrepan¬ 
cies  between  actual  discretionary  spending  and  baseline 
projections  of  such  spending  in  the  same  way  as  differ¬ 
ences  resulting  from  other  budget  legislation.  In  CBO’s 
usual  analyses  of  changes  in  its  projections  since  the  pre¬ 
vious  baseline,  CBO  attributes  a  small  proportion  of  the 
changes  in  assumptions  about  discretionary  outlays  to 
economic  or  technical  changes,  but  legislation  accounts 
for  nearly  all  of  the  overall  change  in  the  form  of  new 
budget  authority.  CBO  decided  on  its  approach  for  sev¬ 
eral  reasons.  First,  it  permits  the  use  of  a  longer  historical 
record.  Second,  levels  of  discretionary  spending  are  deter¬ 
mined  anew  each  year  through  appropriation  acts,  and 
any  discrepancy  between  actual  levels  and  baseline  projec¬ 
tions  of  discretionary  spending  is  essentially  attributable 
to  legislation.  Third,  the  economic  and  technical  effects 
on  projections  of  discretionary  outlays  are  small,  so  at¬ 
tributing  all  of  those  deviations  to  legislation  does  not  af¬ 
fect  the  measures  of  deviations  very  much. 

Deviations  from  projected  net  interest  are  largely  a  result 
of  deviations  from  the  projected  level  of  the  government’s 
publicly  held  debt.  That  debt,  in  turn,  is  the  cumulation 
of  past  budget  deficits  (minus  surpluses),  so  deviations 
from  projected  net  interest  depend  on  the  cumulation  of 
deviations  from  the  projections  of  the  deficit  or  surplus. 
The  final  fan-chart  calculations  include  all  those  effects 
on  net  interest. 

CBO  calculated  differences  between  projections  and  out¬ 
comes  for  each  year  covered  by  the  winter  baseline  projec¬ 
tions  that  it  published  from  1981  through  2005.  In  most 
years,  those  projections  were  issued  in  January  or  Febru¬ 
ary,  although  in  1996,  publication  was  delayed  until  May. 
For  reasons  involving  the  availability  of  data,  CBO  used 
its  July  1981  projection  in  place  of  the  one  published  in 


5.  For  more  information  about  the  purpose  of  CBO’s  baseline  and 
the  rules  that  govern  its  construction,  see  Congressional  Budget 
Office,  The  Budget  and  Economic  Outlook:  Fiscal  Years  2007  to 
2016  (January  2006),  Chapter  1,  and  What  Is  a  Current-Law 
Economic  Baseline!  CBO  Issue  Brief  (June  2005). 


February  1982.^  The  resulting  sample  is  small:  only  24 
current-year  projections,  declining  to  19  five-year- ahead 
projections.7  (The  sample  size  diminishes  because  projec¬ 
tions  made  in  the  past  five  years  can  be  compared  with 
actual  outcomes  only  through  2005.) 

The  estimated  effects  of  legislation  concerning  revenues 
or  mandatory  spending  were  taken  primarily  from  infor¬ 
mation  published  in  CBO’s  twice-yearly  reports  on  the 
budget  and  economic  outlook.  Most  of  those  reports 
show  the  multiyear  budgetary  effects  of  legislation  en¬ 
acted  since  the  previous  projections  were  made.  For  cases 
in  which  estimates  were  not  available  (as  will  be  discussed 
below),  substitutes  were  constructed.8 

Revenues 

The  Joint  Committee  on  Taxation  (JCT)  estimates  the 
effects  of  tax  legislation — bills  that  amend  the  Internal 
Revenue  Code  to  alter  income,  estate  and  gift,  excise,  and 
Social  Security  payroll  taxes — that  is  considered  in  a  ses¬ 
sion  of  Congress  and  provides  the  estimates  to  the  Con¬ 
gressional  Budget  Office  for  use  during  that  session.9 
CBO  is  responsible  for  producing  estimates  for  all  other 
legislation  that  affects  revenues. 

Those  estimated  effects  of  tax  legislation  were  used  to  ad¬ 
just  each  baseline  projection  of  revenues.  For  example, 
the  projection  made  in  January  1999  for  total  revenues  in 
2004  was  lowered  from  $2,184  billion  to  $1,913  billion 
(see  Table  1).  That  adjustment  reflected  all  tax  laws  en¬ 
acted  after  January  1999  and  through  fiscal  year  2004. 
The  three  laws  with  the  largest  budgetary  impacts  were 
the  Economic  Growth  and  Tax  Relief  Reconciliation  Act 


6.  Specifically,  CBO  did  not  have  enough  information  in  its  files  to 
include  the  estimated  effects  of  legislation  enacted  between  Febru¬ 
ary  1982  and  February  1983.  Much  better  data  were  available  for 
the  slightly  longer  period  of  July  1981  through  February  1983. 

7.  With  the  exception  of  1981,  CBO  did  not  include  its  updated 
forecasts  made  in  the  summer,  which  would  have  doubled  the 
sample  size,  because  the  deviations  from  those  forecasts  are  not 
comparable  to  the  deviations  from  the  winter  forecasts.  In  particu¬ 
lar,  the  summer  updates  are  published  near  the  end  of  the  ongoing 
fiscal  year,  so  the  accuracy  for  that  year  would  be  greater  than  that 
associated  with  the  forecast  made  in  the  preceding  winter. 

8.  The  underlying  worksheets  used  in  computing  the  deviations  of 
projections  and  a  brief  explanation  of  each  one  are  available  from 
within  the  electronic  version  of  this  document  at  www.cbo.gov. 

9.  See  Section  201(f)  of  the  Congressional  Budget  Act  of  1974  (as 
amended),  2  U.S.C.  601(f). 
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Table  1 . 


Example:  How  CBO’s  January  1999  Revenue  Projection  Was  Adjusted  for 
Subsequent  Legislation 

(Billions  of  dollars) 

Fiscal  Year 

1999 

2000 

2001 

2002 

2003 

2004 

Baseline  Projection  of  Revenues 

1,815 

1,870 

1,930 

2,015 

2,091 

2,184 

Subsequent  Legislation 

January  1999  to  July  1999 

0 

* 

0 

0 

0 

0 

July  1999  to  January  2000 

0 

3 

-6 

-8 

-2 

-2 

January  2000  to  August  2000 

* 

-1 

-1 

-1 

-1 

August  2000  to  January  2001 

0 

-2 

-2 

-3 

-3 

January  2001  to  August  2001 

-70 

-31 

-84 

-101 

August  2001  to  January  2002 

1 

* 

-2 

-2 

January  2002  to  August  2002 

-43 

-40 

-30 

August  2002  to  January  2003 

0 

* 

* 

January  2003  to  August  2003 

-53 

-135 

August  2003  to  January  2004 

0 

* 

January  2004  to  September  2004 

3 

September  2004  to  January  2005 

0 

Total 

0 

3 

-77 

-86 

-185 

-271 

Adjusted  Baseline  Projection  of  Revenues 

1,815 

1,873 

1,853 

1,929 

1,906 

1,913 

Source:  Congressional  Budget  Office. 

Note:  The  three  major  changes  in  tax  law  enacted  in  the  five  years  after  CBO’s  January  1999  baseline  projection  were  in  the  Economic 

Growth  and  Tax  Relief  Reconciliation  Act  of  2001  (EGTRRA),  the  Job  Creation  and  Worker  Assistance  Act  of  2002  (JCWAA),  and  the 
Jobs  and  Growth  Tax  Relief  Reconciliation  Act  of  2003  (JGTRRA).  The  effects  of  those  laws  were  incorporated  in  CBO's  July  2001, 
August  2002,  and  August  2003  baseline  projections,  respectively.  Several  other  adjustments  were  made  to  account  for  the  effects  of 
other  legislation,  but  they  are  relatively  minor. 

*  =  between  -$500  million  and  $500  million. 


of  2001  (EGTRRA),  the  Job  Creation  and  Worker  Assis¬ 
tance  Act  of  2002  (JCWAA),  and  the  Jobs  and  Growth 
Tax  Relief  Reconciliation  Act  of  2003  (JGTRRA). 

JCT  and  CBO  estimated  that  EGTRRA,  JCWAA,  and 
JGTRRA  would  reduce  revenues  in  fiscal  year  2004  by 
$101  billion,  $30  billion,  and  $135  billion,  respec¬ 
tively.10  Similar  adjustments  were  made  for  the  other 
years  in  the  baseline  projections  and  for  all  of  the  other 
pieces  of  tax  legislation.  The  differences  between  those 


10.  See  Congressional  Budget  Office,  The  Budget  and  Economic  Out¬ 
look:  An  Update  (August  2001),  Table  1-4,  p.  8;  An  Analysis  of  the 
President’s  Budgetary  Proposals  for  Fiscal  Year  2003  (March  2002), 
Box  1,  p.  2;  and  The  Budget  and  Economic  Outlook:  An  Update 
(August  2003),  Table  1-8,  p.  18. 


adjusted  projections  and  actual  revenues  represent  the  de¬ 
viations  attributable  to  economic  and  technical  factors 
(see  Table  2). 

JCT’s  and  CBO’s  estimates  of  the  effects  of  tax  legislation 
generally  are  not  revised  after  their  initial  publication, 
even  though  later  economic  and  technical  information 
might  permit  better  estimates.  (For  instance,  knowledge 
about  an  actual  tax  base,  such  as  wages  or  corporate  prof¬ 
its,  in  a  given  year  would  improve  estimates  of  how  a 
change  in  tax  law  would  affect  revenues.)  Using  unrevised 
estimates  of  the  budgetary  impacts  of  tax  and  spending 
legislation  could  affect  the  estimates  of  uncertainty  in 
CBO’s  baseline  budget  projections,  but  the  direction  and 
size  of  that  effect  are  unclear. 
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Table  2. _ 

Deviations  from  CBO’s  Baseline  Projections  of  Revenues  That  Are  Attributable  to 
Economic  and  Technical  Factors 


(Percentage  of  actual  revenues) 


Fiscal  Year  for  Which  the  Projection  Was  Made 


Date  the  Projection 

Was  Published 

Current 

Year 

Budget 

Year 

Budget 

Year  +  1 

Budget 
Year  +  2 

Budget 
Year  +  3 

Budget 
Year  +  4 

July  1981 

-2.1 

-8.5 

-22.1 

-22.2 

-23.1 

-28.4 

February  1983 

-0.9 

1.3 

0.3 

-3.2 

-2.3 

-3.8 

February  1984 

0.4 

-1.2 

-5.7 

-5.9 

-8.7 

-7.0 

February  1985 

-0.1 

-2.6 

-2.4 

-4.8 

-3.2 

-8.3 

February  1986 

-1.2 

-1.1 

-3.4 

-1.7 

-6.2 

-13.0 

February  1987 

2.4 

-0.1 

1.2 

-3.9 

-11.5 

-15.3 

February  1988 

1.4 

3.8 

-0.7 

-7.3 

-10.5 

-12.4 

February  1989 

0.8 

-3.5 

-9.5 

-12.5 

-13.4 

-12.9 

January  1990 

-3.4 

-9.4 

-12.2 

-13.3 

-12.6 

-12.3 

January  1991 

-3.6 

-6.1 

-8.2 

-7.8 

-7.9 

-6.3 

January  1992 

0.4 

-2.0 

-2.4 

-2.4 

-0.7 

1.8 

January  1993 

1.0 

1.4 

1.3 

3.3 

6.7 

11.3 

January  1994 

0.6 

1.0 

3.0 

6.4 

10.5 

11.4 

January  1995 

-0.2 

2.5 

6.6 

10.9 

11.9 

17.2 

May  1996 

1.7 

5.9 

10.9 

12.3 

17.9 

16.8 

January  1997 

4.4 

9.5 

10.9 

16.7 

15.7 

5.3 

January  1998 

3.3 

5.3 

11.9 

11.2 

0.6 

-2.2 

January  1999 

0.7 

7.5 

7.0 

-4.1 

-6.9 

-1.8 

January  2000 

4.0 

2.3 

-8.9 

-11.9 

-6.1 

0.4 

January  2001 

-3.8 

-16.6 

-21.4 

-16.4 

-9.5 

January  2002 

-4.7 

-10.9 

-8.7 

-3.7 

January  2003 

-4.8 

-2.2 

1.5 

January  2004 

3.2 

6.1 

January  2005 

4.5 

Source:  Congressional  Budget  Office. 

Note:  The  numbers  are  actual  revenues  minus  projected  revenues,  adjusted  for  the  effects  of  legislation. 


Outlays 

The  estimated  effects  of  legislation  on  outlays  (excluding 
net  interest)  were  also  taken  largely  from  CBO’s  reports 
on  the  budget  and  economic  outlook.  However,  as  with 
revenues,  some  adjustments  to  that  information  were 
necessary. 

Baseline  Projections  of  Discretionary  Spending.  As 

noted  previously,  differences  between  actual  and  pro¬ 
jected  levels  of  discretionary  spending  were  assumed  to  be 
attributable  to  legislation.  But  the  July  1981  baseline  pro¬ 
jection  did  not  include  a  separate  category  for  discretion¬ 
ary  spending.  For  that  baseline  only,  discretionary  spend¬ 
ing  was  approximated  by  adding  the  projections  for 


defense,  other  grants  to  state  and  local  governments,  and 
other  federal  operations.11 

Insufficient  Details  About  Legislation.  In  some  cases,  the 
estimated  effects  of  legislation  were  not  reported  in 
enough  detail  to  separate  out  the  effects  of  legislation  on 
mandatory  spending.  In  other  cases,  the  information  was 
published  for  some  but  not  all  of  the  six  years  in  the  base¬ 
line  budget  projection.  One  or  both  of  those  problems 
applied  to  the  following  periods:  August  1986  to  January 
1987,  August  1987  to  February  1988,  August  1994  to 


1 1 .  See  Congressional  Budget  Office,  Baseline  Budget  Projections:  Fis¬ 
cal  Years  1982-1986  (July  198 1),  p.  38. 
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Table  3. 

Deviations  from  CBO’s  Baseline  Projections  of  Outlays  That  Are  Attributable  to 
Economic  and  Technical  Factors 


(Percentage  of  actual  revenues) 


Fiscal  Year  for  Which  the  Projection  Was  Made 


Date  the  Projection 

Was  Published 

Current 

Year 

Budget 

Year 

Budget 

Year  +  1 

Budget 

Year  +  2 

Budget 

Year  +  3 

Budget 

Year  +  4 

July  1981 

-2.4 

-1.6 

-0.7 

-4.1 

-3.5 

-3.4 

February  1983 

-1.3 

-2.1 

-0.8 

0.1 

-0.1 

0.2 

February  1984 

-0.9 

* 

-0.2 

-0.6 

-0.8 

-1.4 

February  1985 

0.3 

1.4 

0.6 

0.8 

0.3 

7.5 

February  1986 

2.0 

1.6 

1.9 

1.1 

8.3 

8.7 

February  1987 

-1.1 

0.8 

-0.4 

6.3 

6.4 

7.2 

February  1988 

0.7 

-0.5 

5.6 

5.8 

6.8 

4.6 

February  1989 

-1.1 

5.6 

5.2 

6.2 

4.1 

5.4 

January  1990 

4.4 

3.9 

4.8 

2.6 

3.9 

2.2 

January  1991 

-7.2 

-7.4 

-3.7 

-0.8 

3.3 

2.8 

January  1992 

-5.6 

-7.6 

-3.4 

-0.9 

1.3 

-1.9 

January  1993 

-3.2 

-2.8 

-4.3 

-2.6 

-3.4 

-3.8 

January  1994 

-1.0 

-1.3 

-1.2 

-3.5 

-4.0 

-4.7 

January  1995 

-1.0 

-2.1 

-3.9 

-4.2 

-4.9 

-5.5 

May  1996 

-0.8 

-2.6 

-3.7 

-4.0 

-4.5 

-5.7 

January  1997 

-1.7 

-1.7 

-2.7 

-3.6 

-4.2 

-2.3 

January  1998 

-0.5 

-1.2 

-2.2 

-2.5 

-0.3 

-1.8 

January  1999 

* 

-0.8 

-0.8 

1.3 

0.6 

-0.2 

January  2000 

-0.2 

* 

2.3 

2.3 

1.3 

1.8 

January  2001 

-0.3 

1.3 

1.6 

0.4 

0.4 

January  2002 

-0.2 

0.2 

1.1 

2.1 

January  2003 

-0.4 

-0.3 

1.1 

January  2004 

-0.3 

0.9 

January  2005 

0.1 

Source:  Congressional  Budget  Office. 

Note:  The  numbers  are  actual  outlays  minus  projected  outlays,  adjusted  for  the  effects  of  legislation.  They  exclude  deviations  from  the  base¬ 
line  projections  of  discretionary  spending  (which  are  assumed  to  be  attributable  solely  to  legislation)  and  in  the  baseline  projections  of 
net  interest  (which  depend  on  the  deviations  from  the  surplus  excluding  interest). 

*  =  between  -0.05  percent  and  0.05  percent. 


January  1995,  and  January  1998  to  August  1998.  In 
those  cases,  supplemental  information  from  CBO’s  files 
was  used  to  estimate  the  needed  numbers. 

As  with  revenues,  the  estimated  effects  of  legislation  on 
outlays  were  used  to  adjust  each  baseline  projection  of 
outlays.  After  removing  interest  payments  and  discretion¬ 
ary  outlays,  the  differences  between  those  adjusted  pro¬ 
jections  and  actual  outlays  are  the  changes  attributable  to 
economic  and  technical  factors  (see  Table  3). 


Primary  Budget  Deficit  or  Surplus 

The  difference  between  revenues  and  outlays  excluding 
net  interest  is  known  as  the  primary  budget  surplus  (or 
deficit  when  negative).  Correspondingly,  the  deviations 
from  CBO’s  projections  of  revenues,  minus  the  devia¬ 
tions  from  its  projections  of  noninterest  outlays,  equal 
the  deviations  from  its  projections  of  the  primary  deficit 
or  surplus  (see  Table  4).  As  described  previously,  that  cal¬ 
culation  excludes  legislative  changes.  In  stage  two  of  the 
fan-chart  preparation,  the  deviations  from  the  projected 
primary  budget  deficits  or  surpluses  were  cumulated  into 
deviations  from  the  projected  level  of  the  publicly  held 
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Table  4. 


Deviations  from  CBO’s  Baseline  Projections  of  the  Primary  Deficit  or  Surplus 
That  Are  Attributable  to  Economic  and  Technical  Factors 

(Percentage  of  actual  revenues) 

Fiscal  Year  for  Which  the  Projection  Was  Made 

Date  the  Projection 

Was  Published 

Current 

Year 

Budget 

Year 

Budget 
Year  +  1 

Budget 
Year  +  2 

Budget 
Year  +  3 

Budget 

Year  +  4 

July  1981 

0.3 

-6.8 

-21.3 

-18.1 

-19.6 

-25.0 

February  1983 

0.4 

3.3 

1.1 

-3.3 

-2.1 

-4.0 

February  1984 

1.2 

-1.3 

-5.5 

-5.3 

-7.9 

-5.6 

February  1985 

-0.4 

-4.0 

-2.9 

-5.7 

-3.5 

-15.8 

February  1986 

-3.2 

-2.7 

-5.3 

-2.8 

-14.5 

-21.7 

February  1987 

3.5 

-1.0 

1.6 

-10.1 

-17.9 

-22.6 

February  1988 

0.7 

4.3 

-6.3 

-13.2 

-17.3 

-17.1 

February  1989 

1.9 

-9.2 

-14.7 

-18.7 

-17.5 

-18.2 

January  1990 

-7.8 

-13.3 

-17.0 

-15.9 

-16.4 

-14.5 

January  1991 

3.6 

1.3 

-4.5 

-7.0 

-11.2 

-9.1 

January  1992 

6.0 

5.6 

1.0 

-1.5 

-2.0 

3.8 

January  1993 

4.2 

4.2 

5.6 

5.9 

10.1 

15.1 

January  1994 

1.6 

2.3 

4.2 

10.0 

14.4 

16.1 

January  1995 

0.8 

4.6 

10.5 

15.1 

16.8 

22.7 

May  1996 

2.5 

8.5 

14.6 

16.3 

22.4 

22.5 

January  1997 

6.1 

11.3 

13.6 

20.3 

19.9 

7.6 

January  1998 

3.8 

6.5 

14.1 

13.7 

0.9 

-0.4 

January  1999 

0.7 

8.3 

7.8 

-5.4 

-7.5 

-1.5 

January  2000 

4.2 

2.3 

-11.2 

-14.1 

-7.3 

-1.4 

January  2001 

-3.5 

-17.9 

-23.0 

-16.7 

-9.9 

January  2002 

-4.5 

-11.1 

-9.8 

-5.8 

January  2003 

-4.4 

-1.9 

0.4 

January  2004 

3.4 

5.2 

January  2005 

4.4 

Source:  Congressional  Budget  Office. 

Note:  The  numbers  are  actual  surpluses  minus  projected  surpluses,  adjusted  for  the  effects  of  legislation.  They  exclude  deviations  from  the 
baseline  projections  of  discretionary  spending  (which  are  assumed  to  be  attributable  solely  to  legislation)  and  in  the  baseline  projec¬ 
tions  of  net  interest  (which  depend  on  the  deviations  from  the  surplus  excluding  interest). 


debt,  which  were  used  to  estimate  the  uncertainty  of 
CBO’s  projections  of  net  interest. 

Stage  Two:  Constructing  Probability 
Distributions 

The  historical  record  of  deviations  from  CBO’s  projec¬ 
tions  of  the  primary  deficit  or  surplus  (adjusted  for  legis¬ 
lation)  presented  in  Table  4  forms  the  basis  for  the  statis¬ 
tical  calculations  that  CBO  used  to  derive  the  probability 
distributions  underlying  the  fan  chart.  As  noted  above, 
CBO’s  record  of  projections  is  both  short  and  possibly 
unrepresentative  (in  that  it  is  taken  from  a  period  that 


contains  fewer  and  less  frequent  business  cycles  than  oc¬ 
curred  historically).  In  the  absence  of  a  large  sample,  esti¬ 
mates  may  be  improved  if  additional  information  can  be 
brought  to  bear.  In  this  case,  CBO  used  its  knowledge  of 
its  forecasting  procedures  and  of  business  cycles,  as  well  as 
its  historical  record,  to  draw  more-reliable  conclusions 
about  the  probability  distribution  of  deviations  from  its 
budget  projections. 

The  Statistical  Model  for  Deviations  from  Forecasts 
of  the  Primary  Deficit  or  Surplus 

With  the  effects  of  legislation  removed,  differences  be¬ 
tween  CBO’s  past  projections  and  actual  budget  out- 
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comes  are  closely  related  to  the  agency’s  accuracy  in  pro¬ 
jecting  the  business  cycle.  Forecasting  the  course  of  a 
business  cycle  more  than  two  years  ahead  is  virtually  im¬ 
possible,  so  CBO  has  traditionally  tried  to  incorporate 
the  business  cycle  in  its  economic  projections  explicitly 
for  only  the  current  year  and  the  budget  year. 12  In  its  pro¬ 
jections  for  longer  horizons,  CBO  simply  assumes  that 
gross  domestic  product  (GDP)  will,  on  average,  adhere  to 
its  trend  (or  “potential”)  path.13  That  assumption  recog¬ 
nizes  that,  in  fact,  GDP  will  sometimes  be  above  and 
sometimes  below  its  potential  level,  but  CBO  does  not 
attempt  to  forecast  those  boom  or  recession  periods  more 
than  a  couple  of  years  ahead. 

As  long  as  CBO  continues  to  do  a  reasonably  good  job  of 
forecasting  the  business  cycle  for  the  current  year,  that 
cycle  should  have  only  a  small  impact  on  the  accuracy  of 
current-year  budget  projections.  For  the  budget  year,  its 
contribution  should  be  larger  (because  accuracy  in  fore¬ 
casting  diminishes  as  the  horizon  lengthens)  but  still 
modest.  For  later  years,  however,  cyclical  factors  should 
loom  larger.  For  the  last  two  years  of  the  five-year  projec¬ 
tion  period,  CBO  assumes  that  GDP  is  the  same  as  or 
close  to  its  potential  level.  Thus,  any  actual  difference  be¬ 
tween  GDP  and  its  potential  will  not  be  reflected  in  those 
budget  projections.  Consequently,  as  the  projection  hori¬ 
zon  extends,  the  deviations  from  budget  estimates  that 
result  from  unexpected  changes  in  the  business  cycle 
should,  on  average,  grow  in  importance,  until  they  reach 
their  maximum  level  in  the  last  two  years  of  the  five-year 
period. 

The  portion  of  deviations  attributable  to  the  business  cy¬ 
cle  may  be  estimated  by  using  the  correlation  between 
those  deviations  and  the  GDP  gap  (the  percentage  differ¬ 
ence  between  actual  GDP  and  its  potential  value).  Ac¬ 
cording  to  the  above  analysis,  for  projections  several  years 
ahead,  the  level  of  the  GDP  gap  is  a  good  indicator  of  un¬ 
expected  cyclical  conditions.  For  projections  only  one  or 
two  years  ahead,  by  contrast,  the  change  in  the  GDP  gap 


12.  In  relation  to  CBO’s  baseline,  the  current  year  is  the  fiscal  year  in 
which  the  projection  is  made  and  the  budget  year  is  the  following 
fiscal  year  (the  one  for  which  the  budget  is  under  consideration) . 
Years  beyond  the  budget  year  are  referred  to  as  out-years. 

13.  See  Congressional  Budget  Office,  CBO’s  Method  for  Estimating 
Potential  Output:  An  Update  (August  2001),  and  A  Summary  of 
Alternative  Methods  for  Estimating  Potential  GDP  (March  2004). 


may  be  a  better  indicator  of  cyclical  surprises  than  the 
level,  because  the  approaching  levels  of  the  gap  can  be 
quite  similar  to  the  recent  level. 

Using  the  GDP  gap  and  its  change  to  measure  unforeseen 
changes  in  cyclical  conditions,  CBO  estimated  by  means 
of  a  linear  regression  what  portion  of  past  deviations  was 
attributable  to  business  cycles  (see  Box  1).  Restrictions  on 
the  regression  incorporate  the  view  that,  of  the  two  vari¬ 
ables,  the  change  in  the  GDP  gap  is  the  main  source  of 
uncertainty  over  shorter  horizons  and  the  level  of  the  gap 
over  longer  ones.  For  the  intermediate  year  (the  first  year 
after  the  two-year  forecast),  both  the  level  of  the  GDP 
gap  and  its  change  are  taken  to  be  important  indicators  of 
unexpected  cyclical  changes. 

The  portion  of  the  overall  deviations  explained  by  the 
two  business-cycle  variables  in  the  regression  is  called  the 
cyclical  part.  The  rest,  the  noncyclical  part,  represents  the 
deviations  that  result  from  such  factors  as  noncyclical 
changes  in  average  tax  rates,  capital  gains  realizations,  the 
share  of  GDP  that  goes  to  taxpayers  in  high  tax  brackets, 
and  federal  spending  for  Medicare  and  Medicaid.14 

CBO  does  not  expect  its  projections  to  display  a  negative 
or  positive  bias — otherwise  it  would  change  them.  Ac¬ 
cordingly,  CBO  assumed  that  the  probability  distribution 
of  deviations  from  its  projections  was  centered  around  an 
average  of  zero.  The  data  do  not  contradict  that  assump¬ 
tion;  the  average  of  past  deviations  for  each  horizon  is  not 
statistically  significantly  different  from  zero. 

Calculating  the  Distribution  of  Deviations  from  the 
Model 

The  regression  model  produces  coefficients  that  relate  de¬ 
viations  from  the  primary  deficit  or  surplus  (shown  in 
Table  4)  to  the  business-cycle  variables.  Given  the  histori¬ 
cal  pattern  of  the  business  cycle,  those  coefficients  can  be 
used  to  describe  the  distribution  of  deviations  that  might 
be  expected  to  occur  simply  because  of  the  business  cycle. 
One  way  to  describe  that  distribution  is  through  the  root- 
mean-square  error  (RMSE),  a  measure  of  the  average  size 
of  the  errors  that  ignores  the  signs  of  individual  errors 


14.  For  a  discussion  of  various  factors  affecting  budget  revenues  and 
outlays,  see  Congressional  Budget  Office,  The  Budget  and  Eco¬ 
nomic  Outlook:  Fiscal  Years  2007  to  2016,  Chapters  3  and  4. 
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Box  1. 

Regression  Equation  for  the  Analysis  of  Uncertainty 


To  estimate  the  effect  of  the  business  cycle  on  the 
deviations  of  its  past  budget  projections  from  ac¬ 
tual  outcomes,  the  Congressional  Budget  Office 
(CBO)  used  the  following  regression  equation: 

et,h  =  hi whdt+h  +  h2(l  -  wh)gt+h  +  residual \h 

where: 

etfj  =  the  deviation  in  projecting  the  primary  deficit 
or  surplus  (as  a  percentage  of  actual  revenues)  for  the 
//-year-out  forecast  published  in  fiscal  year  t, 

gt+[j  =  the  GDP  gap  in  year  t+b,  and 

dt+[j  =  the  change  in  the  GDP  gap  between  the  level 
known  at  the  time  of  the  projection  and  the  level  in 
the  year  for  which  the  projection  was  made  (in  other 
words  ,dt+h=gt+h-gt_j). 

(Note  thatj^  is  not  known  at  the  time  of  the 
projection  published  in  January  of  year  t.)  The 
projection  horizon  h  runs  from  the  current  year 


( h  =  0)  through  the  budget  year  (b  =  1 )  to  the 
fourth  year  after  the  budget  year  (h  =  5). 

The  variables  dt+ ^  and  gl+f,  are  multiplied  by 
weights — w jj  and  ( 1  -  w^) — that  restrict  their  ef¬ 
fect  at  different  projection  horizons.  The  weights 
are  chosen  so  that,  for  the  four-  and  five-year- 
ahead  projections,  the  forecast  deviation  depends 
only  on  gt+ ^  and  for  the  current  year,  the  devia¬ 
tion  depends  only  on  dt+fj.  In  other  words,  = 
Wj  =  0  and  Wq=  1 .  The  weights  at  other  horizons 
are  Wj  =  0.8,  W2  =  0.5,  and  wj  =  0.1.  Those 
weights  are  not  determined  statistically  but  rep¬ 
resent  a  reasonable  transition  from  CBO’s  near- 
term  forecast  to  its  medium-term  projection. 

The  two  measures  gt+^  and  dt+^  are  assumed  to 
have  different  impacts  on  forecast  deviations 
(different  and  J? 2)  because,  although  gt+^  is 

completely  unforeseen  (for  out-years),  dt+^  can 
be  partly  forecast,  especially  for  the  current  bud¬ 
get  year.  and  J?2  are  estimated  at  1.6  and  6.2, 
respectively,  both  with  a  standard  error  of  0.6. 


and  gives  extra  weight  to  large  errors.15  The  model  as¬ 
sumes  that  the  RMSE  of  the  cyclical  part  of  deviations 
will  rise  to  a  plateau  (see  Figure  2). 

That  model  does  not  account  for  all  of  the  deviation  from 
a  given  projection,  however.  What  is  left,  the  noncyclical 


15.  The  RMSE  is  calculated  by  squaring  the  deviation  from  each  pro¬ 
jection,  averaging  the  squares,  and  taking  the  square  root  of  the 
result.  (For  distributions  with  a  mean  of  zero,  the  RMSE  is  equal 
to  the  standard  deviation.)  The  RMSE  forms  the  basis  for  CBO’s 
calculation  of  the  fan  chart.  Roughly  speaking,  a  band  of  plus  or 
minus  one  RMSE  from  a  projection  encompasses  about  two- 
thirds  of  the  likely  variation — that  is,  the  outcome  is  likely  to  be 
within  one  RMSE  of  the  estimate  about  two-thirds  of  the  time. 
Other  confidence  intervals  in  the  fan  chart  are  also  calculated 
from  RMSEs. 


part,  also  has  a  distribution  that  can  be  summarized  by  its 
RMSE.  Like  the  cyclical  component,  that  part  of  a  devia¬ 
tion  has  an  RMSE  that  rises  as  the  projection  horizon 
lengthens,  but  it  does  not  plateau  (see  Figure  2).  For  sim¬ 
plicity,  CBO  assumed  that  the  noncyclical  influences  cap¬ 
tured  in  the  residual  from  the  regression  were  indepen¬ 
dent  of  the  cyclical  component  at  each  horizon.16  That 
assumption  is  not  contradicted  by  the  data,  and  using  the 


16.  The  fitted  part  and  the  residual  from  the  regression  are  taken, 
respectively,  to  be  the  cyclical  and  noncyclical  parts  of  the  devia¬ 
tions.  By  construction,  those  two  parts  are  uncorrelated  for  the 
whole  regression  sample,  which  pools  the  deviations  for  the  six 
different  horizons,  but  the  two  parts  have  sample  correlations  dif¬ 
ferent  from  zero  at  individual  forecast  horizons. 
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Figure  3. 

CBO’s  Past  Deviations  in  Projecting  the  Primary  Surplus,  Compared  with  the 
Constructed  90  Percent  Confidence  Ranges 


(Percentage  of  GDP) 


Source:  Congressional  Budget  Office. 

Note:  Each  thin  line  represents  the  actual  deviations  from  the  set  of  projections  made  in  a  given  year.  The  thick  lines  represent  the  90  per¬ 
cent  confidence  range  constructed  from  CBO’s  statistical  model  for  deviations.  That  range  encompasses  most  of  CBO’s  past  record. 


sample  correlations  makes  little  difference  to  the 
results.17 

The  estimated  RMSEs  for  the  cyclical  and  noncyclical 
parts  can  be  combined  to  form  an  estimate  of  the  RMSE 
for  the  total  budget  deviation.  Two  RMSEs  are  combined 
by  squaring  each  of  them,  adding  those  squares  together, 
and  taking  the  square  root  of  the  sum.  While  each  devia¬ 
tion  is  the  sum  of  its  cyclical  and  noncyclical  parts,  the 
RMSE  is  less  than  the  sum  of  the  RMSEs  of  the  two  parts 
because  the  two  parts  sometimes  offset  each  other  (see 


17.  Because  the  sample  of  projections  is  small,  CBO,  to  estimate  the 
distribution  of  deviations  with  any  confidence,  assumed  that  the 
deviations  shown  in  Table  4  were  generated  by  a  normal  distribu¬ 
tion.  The  kurtosis  (a  measure  of  how  thick  the  tails  of  the  proba¬ 
bility  distribution  are)  and  skewness  of  the  deviations  in  the 
sample  are  consistent  with  that  assumption.  The  kurtosis  and 
skewness  were  not  statistically  different  from  those  of  a  normal 
distribution  at  any  conventional  significance  level  at  any  of  the 
horizons. 


Figure  2).  For  example,  when  the  cyclical  part  is  positive, 
the  noncyclical  part  could  be  negative,  resulting  in  a  total 
deviation  that  is  smaller  in  size  than  the  sum  of  the  abso¬ 
lute  size  of  the  two  parts. 

The  estimated  RMSEs  for  a  given  year  were  formulated 
as  a  percentage  of  that  year’s  actual  revenues.  For  the  pro¬ 
jection  of  the  total  primary  deficit  or  surplus,  those  RM¬ 
SEs  can  be  converted  into  dollars  or  expressed  as  a  per¬ 
centage  of  GDP  using  CBO’s  current  baseline  projections 
of  total  revenues  and  GDP. 

The  model’s  estimate  of  the  distribution  of  differences  be¬ 
tween  CBO’s  projections  and  budget  outcomes  appears 
generally  consistent  with  CBO’s  past  record.  Out  of  129 
past  deviations  from  projections  of  the  primary  deficit  or 
surplus  made  in  the  1981-2005  period,  6  percent  fell  out¬ 
side  the  calculated  90  percent  confidence  range — a  range 
that  ought,  in  a  large  enough  sample,  to  encompass  90 
percent  of  the  observations  (see  Figure  3). 
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Figure  4. 

Deviations  from  CBO’s  Primary  Surplus  Projections 
Made  Between  1981  and  2005 

(Percentage  of  GDP) 
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Source:  Congressional  Budget  Office. 

Notes:  CY  =  current  year;  BY  =  budget  year. 

This  figure  shows  the  deviations  from  CBO’s  projections  of  the  primary  deficit  or  surplus — the  total  deficit  or  surplus  excluding  net 
interest — made  at  different  times.  Plotted  points  that  lie  below  the  center  line  reflect  instances  in  which  CBO  underestimated  the  pri¬ 
mary  deficit  or  overestimated  the  primary  surplus,  whereas  points  above  the  center  line  reflect  the  opposite.  In  each  panel,  the 
shaded  cone  indicates  the  estimated  90  percent  confidence  band;  that  is,  there  was  a  90  percent  chance  that  CBO's  projection  would 
be  within  the  shaded  area.  CBO  estimated  that  confidence  band  on  the  basis  of  its  forecasting  record  since  1981  (excluding  1982, 
because  of  insufficient  data). 

The  figure  excludes  the  effects  of  legislation  enacted  after  the  projections  were  made. 


1986  1987  1988  1989 


THE  UNCERTAINTY  OF  BUDGET  PROJECTIONS:  A  DISCUSSION  OF  DATA  AND  METHODS  1 3 


Figure  5. 

Deviations  from  the  1996  Primary  Surplus  Projection 


(Percentage  of  GDP) 


Source:  Congressional  Budget  Office. 

Notes:  CY  =  current  year;  BY  =  budget  year. 

This  figure  shows  the  deviations  from  CBO’s  projection  of  the  primary  deficit  or  surplus — the  total  deficit  or  surplus  excluding  net 
interest — made  in  1996.  The  plotted  points,  all  of  which  lie  above  the  center  line,  reflect  instances  in  which  CBO  overestimated  the 
primary  deficit  or  underestimated  the  primary  surplus.  The  outside  cone  indicates  the  estimated  90  percent  confidence  band;  that  is, 
there  was  a  90  percent  chance  that  CBO’s  projection  would  be  within  the  area  of  the  cone.  CBO  estimated  that  confidence  band  on  the 
basis  of  its  forecasting  record  since  1981  (excluding  1982,  because  of  insufficient  data). 

The  figure  excludes  the  effects  of  legislation  enacted  after  the  projections  were  made. 


Figure  4  shows  the  90  percent  confidence  bands  for  the 
primary  surplus  projections  together  with  the  deviations 
from  the  individual  baselines  from  1981  through  2005. 
The  figure  shows  that  the  five-year  projections  made  in 
1991  and  before  tended  to  be  too  optimistic,  while  the 
projections  made  between  1993  and  1998  were  too  pessi¬ 
mistic.  Those  were  followed  by  the  1 999  and  2000  pro¬ 
jections,  which  were  too  pessimistic  for  the  early  years 
and  too  optimistic  for  the  later  years.  The  record  for  the 
last  five  years  of  projections  is  not  complete.  So  far,  how¬ 
ever,  the  projections  made  in  2001  and  2002  have  proved 
to  be  too  optimistic.  The  primary  source  of  deviations 
from  the  baselines  between  1993  and  1998  was  the  un¬ 
foreseen  economic  boom  of  the  late  1990s  and  the  associ¬ 
ated  rapid  rise  in  revenues.  For  the  earlier  baseline  projec¬ 
tions,  the  primary  sources  of  deviations  were  the 
unexpected  continuation  of  the  productivity  slowdown 
that  started  in  the  1970s  and  the  recessions  of  1981-1982 


and  1990-1991.  The  primary  sources  of  deviations  from 
the  projections  made  between  2001  and  2003  were  the 
2001  recession,  a  slower- than-expected  recovery  from 
that  recession,  and  a  fall  in  taxable  income  shares  in  GDP. 

CBO  computes  the  uncertainty  range  for  only  the  first 
five  years,  although  the  projections  have  covered  a  period 
of  10  years  beginning  with  the  1996  baseline.  The  fan 
does  not  extend  to  the  second  five  years  because  the 
record  of  deviations  beyond  the  first  five  years  is  too  small 
to  make  reliable  inferences  about  the  uncertainty  range 
for  those  years,  and  such  estimates  could  be  misleading. 
For  example,  the  1 996  forecast,  which  is  the  first  CBO 
forecast  that  covered  a  1 0-year  period  (and  which  con¬ 
tains  four  of  the  10  data  points  beyond  the  fifth  year  of 
the  projections),  generally  had  larger  deviations  in  the 
first  five  years  than  in  the  sixth  through  ninth  years  of 
that  projection  (see  Figure  5).  Generally,  though,  devia- 
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Table  5. 

Estimated  Probability  Distribution  for  the  January  2006  CBO  Projection  of  the 
Total  Budget  Deficit  or  Surplus 

(Billions  of  dollars) 


Percentile 

2006 

2007 

2008 

2009 

2010 

2011 

5 

-503 

-581 

-719 

-803 

-929 

-1,015 

10 

-467 

-513 

-618 

-679 

-773 

-816 

15 

-442 

-466 

-549 

-595 

-668 

-682 

20 

-422 

-430 

-495 

-529 

-584 

-575 

25 

-405 

-398 

-448 

-472 

-512 

-483 

30 

-390 

-370 

-406 

-420 

-448 

-401 

35 

-376 

-343 

-367 

-373 

-388 

-325 

40 

-363 

-318 

-330 

-328 

-331 

-253 

45 

-350 

-294 

-294 

-284 

-276 

-183 

50 

-337 

-270 

-259 

-241 

-222 

-114 

55 

-324 

-247 

-224 

-198 

-168 

-45 

60 

-311 

-223 

-188 

-155 

-114 

25 

65 

-298 

-198 

-151 

-109 

-57 

97 

70 

-284 

-171 

-112 

-62 

3 

173 

75 

-269 

-143 

-71 

-11 

68 

256 

80 

-252 

-111 

-24 

46 

139 

347 

85 

-232 

-74 

31 

113 

223 

454 

90 

-207 

-28 

99 

197 

328 

588 

95 

-170 

41 

201 

321 

485 

787 

Source:  Congressional  Budget  Office. 

Note:  These  numbers — constructed  using  the  percentiles  of  the  standard  normal  distribution  and  a  simple  probability  model  based  on  CBO’s 
forecasting  record — underlie  the  fan  chart  presented  as  Figure  1.  The  row  in  the  table  corresponding  to  the  50th  percentile  is  CBO’s 
current  baseline  projection  of  the  deficit. 

These  estimates  permit  the  construction  of  probability  statements  about  CBO’s  baseline  projection  of  the  total  budget  deficit  or  sur¬ 
plus.  For  example,  the  table  indicates  that  there  is  a  90  percent  chance  that  the  budget’s  balance  in  2007  (the  budget  year)  will  be 
somewhere  between  a  $581  billion  deficit  and  a  $41  billion  surplus,  and  a  50  percent  chance  that  the  deficit  or  surplus  in  2011  (the 
budget  year  +  4)  will  be  within  $369  billion  of  the  baseline  projection.  (That  last  calculation  takes  the  range  from  the  25th  to  the  75th 
percentiles  and  halves  it.) 


tions  for  years  beyond  the  five-year  forecast  would  be 
larger  (not  smaller)  than  those  for  the  first  five  years.  In 
the  particular  case  of  the  1996  forecast,  the  deviations  in 
the  first  five  years,  which  resulted  from  the  unexpected 
strength  of  the  economy  and  the  rise  in  taxable  income 
shares,  were  reduced  significantly  in  the  sixth  through 
ninth  years  by  the  unforeseen  effects  of  the  2001  reces¬ 
sion  and  the  fall  in  taxable  income  shares. 

Uncertainty  in  Projections  of  the  Total  Deficit  or 
Surplus 

Determining  the  uncertainty  range  for  CBO’s  current 
baseline  projection  of  the  total  deficit  or  surplus  (shown 
in  Figure  1)  requires  information  about  how  the  devia¬ 
tions  from  the  primary  budget  (the  budget  excluding  net 


interest)  will  affect  the  government’s  debt-service  costs. 
Those  deviations  from  budget  outcomes  are  run  through 
a  simple  debt-service  model  that  tracks  how  they  translate 
into  deviations  from  the  projected  debt  service;  the  model 
applies  an  interest  rate  that  is  a  weighted  average  of 
CBO’s  current  baseline  projections  of  rates  on  three- 
month  Treasury  bills  and  10-year  Treasury  notes.  That 
model  is  an  approximation  of  the  model  CBO  uses  for  its 
budget  projections.  The  deviations  from  interest  rate  pro¬ 
jections  are  not  considered  because  their  contribution  to 
deviations  from  overall  budget  projections  is  not  expected 
to  be  substantial. 

The  extent  to  which  the  deviations  from  projections  of 
the  primary  deficit  or  surplus  are  correlated  across  hori- 
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Table  6. 


Estimated  Probability  Distribution  for  the  January  2006  CBO  Projection  of  the 
Total  Budget  Deficit  or  Surplus 

(Percentage  of  GDP) 

Percentile  2006 

2007 

2008 

2009 

2010 

2011 

5 

-3.8 

-4.2 

-5.0 

-5.3 

-5.8 

-6.1 

10 

-3.6 

-3.7 

-4.3 

-4.4 

-4.8 

-4.9 

15 

-3.4 

-3.4 

-3.8 

-3.9 

-4.2 

-4.1 

20 

-3.2 

-3.1 

-3.4 

-3.5 

-3.6 

-3.4 

25 

-3.1 

-2.9 

-3.1 

-3.1 

-3.2 

-2.9 

30 

-3.0 

-2.7 

-2.8 

-2.8 

-2.8 

-2.4 

35 

-2.9 

-2.5 

-2.5 

-2.4 

-2.4 

-1.9 

40 

-2.8 

-2.3 

-2.3 

-2.1 

-2.1 

-1.5 

45 

-2.7 

-2.1 

-2.0 

-1.9 

-1.7 

-1.1 

50 

-2.6 

-2.0 

-1.8 

-1.6 

-1.4 

-0.7 

55 

-2.5 

-1.8 

-1.5 

-1.3 

-1.1 

-0.3 

60 

-2.4 

-1.6 

-1.3 

-1.0 

-0.7 

0.1 

65 

-2.3 

-1.4 

-1.0 

-0.7 

-0.4 

0.6 

70 

-2.2 

-1.2 

-0.8 

-0.4 

0 

1.0 

75 

-2.1 

-1.0 

-0.5 

-0.1 

0.4 

1.5 

80 

-1.9 

-0.8 

-0.2 

0.3 

0.9 

2.1 

85 

-1.8 

-0.5 

0.2 

0.7 

1.4 

2.7 

90 

-1.6 

-0.2 

0.7 

1.3 

2.0 

3.5 

95 

-1.3 

0.3 

1.4 

2.1 

3.0 

4.7 

Source:  Congressional  Budget  Office. 

Notes:  These  numbers — constructed  using  the  percentiles  of  the  standard  normal  distribution  and  a  simple  probability  model  based  on  CBO’s 
forecasting  record — underlie  the  fan  chart  presented  as  Figure  1.  The  row  in  the  table  corresponding  to  the  50th  percentile  is  CBO’s 
current  baseline  projection  of  the  deficit  as  a  percentage  of  GDR 

These  estimates  permit  the  construction  of  probability  statements  about  CBO’s  baseline  projection  of  the  total  budget  deficit  or  sur¬ 
plus.  For  example,  the  table  indicates  that  there  is  a  90  percent  chance  that  the  budget’s  balance  in  2007  (the  budget  year)  will  be 
somewhere  between  a  deficit  of  4.2  percent  of  GDP  and  a  surplus  of  0.3  percent  of  GDR  and  a  50  percent  chance  that  the  deficit  or  sur¬ 
plus  in  2011  (the  budget  year  +  4)  will  be  within  2.2  percent  of  GDP  of  the  baseline  projection  (or  half  of  the  range  from  the  25th  to 
the  75th  percentiles). 


zons  is  important  for  the  computation  of  debt-service 
costs.  When  those  deviations  are  highly  correlated,  they 
have  a  larger  accumulated  effect  on  outstanding  debt,  and 
the  associated  change  in  the  government’s  interest  burden 
is  larger.  In  calculating  the  probability  distribution  of  de¬ 
viations  from  projections  of  the  total  deficit  or  surplus 
(including  net  interest),  CBO  assumed  that  the  cyclical 
and  noncyclical  parts  would  continue  to  have  the  same 
correlation  structure  as  in  the  past.18  The  percentiles  for 
the  total  deficit  or  surplus  that  are  used  to  draw  the  fan 
chart  are  computed  by  multiplying  the  values  associated 
with  the  various  percentiles  for  the  standard  normal  dis¬ 
tribution  by  the  calculated  RMSE  of  the  probability  dis¬ 
tribution  of  the  total  deficit  or  surplus  at  different  hori¬ 


zons.  Those  percentiles  are  shown  in  Table  5  in  billions  of 
dollars  and  in  Table  6  as  percentages  of  GDP. 

CBO  will  continue  its  efforts  to  refine  these  calcula¬ 
tions  and  welcomes  suggestions  for  improving  the 
methodology. 


18.  Interest  payments  increase  the  RMSE  of  the  probability  distribu¬ 
tion  of  deviations.  However,  they  do  not  alter  the  assumption  that 
deviations  are  normally  distributed,  because  the  changes  in  debt- 
service  costs  are  a  linear  function  of  the  current  and  past  changes 
in  the  primary  budget  balance.  The  RMSE  of  the  total  deficit  or 
surplus,  in  fact,  is  computed  using  that  linear  relationship. 


